


Europaisches 
Patentamt 



European 
Patent Office 



Office europeen 
des brevets 



Bescheinigung Certificate Attestation 



Die angehefteten Unterla- 
gen stimmen mit der 
ursprunglich eingereichten 
Fassung der auf dem nach- 
sten Blatt bezeichneten 
europaischen Paten tan mel- 
dung Qberein. 



The attached documents 
are exact copies of the 
European patent application 
described on the following 
page, as originally filed. 



Les documents fixes a 
cette attestation sont 
conform es a ia version 
initialement deposee de 
la demande de brevet 
europeen specif iee a la 
page suivante. 



Patentanmeldung Nr. Patent application No. Demande de brevet n° 

04100879.8 ^/ 



\ PRIORITY 
DOCUMENT 

i SUBMITTED OR TRANSMITTED IN 
! COMPLIANCE WITH RULE 17.1(a) OR (b) 

i 



Der Prasident des Europaischen Patentamts; 
Im Auftrag 

For the President of the European Patent Office 

Le President de I'Offlce europeen des brevets 
p.o. 




R C van Dijk 



EPA/EPO/OEB Form 1014.1 - 02.2000 7001014 



Europaisches 
Patentamt 



European 
Patent Office 



Office europeen 
des brevets 



Anmeldung Nr; 
Application no. : 
Demande no: 



04100879.8 



Anmeldetag: 

Date of filing: 04.03.04 J 
Date de depot: 



Anmel der/Appl 1 cant( s)/Demandeur( s) : 

Philips Intellectual Property & Standards 
GmbH 

Steindamm 94 
20099 Hamburg 
ALLEMAGNE 

Koninklijke Philips Electronics N.V. 
Groenewoudseweg 1 
5621 BA Eindhoven 
PAYS-BAS 



Bezel chnung der Erf Indung/Tltle of the 1nvent1on/T1tre de 1 1 Invention: 
(Falls die Bezel chnung der Erflndung nlcht angegeben 1st, slehe Beschrelbung, 
If no title 1s shown please refer to the description. 
S1 aucun tltre n'est 1nd1qu6 se referer a la description.) 

Apparatus and method for the processing of perfusion images 

In Anspruch genommene Pr1or1at(en) / Priori tyCies) claimed /Prlorlte(s) 
revend1qu£e(s) 

Staat/Tag/Aktenze1 chen/State/Date/Fl 1 e no. /Pay s/Date/Numero de depot: 



Internationale Patentklasslf 1 katlon/Internatlonal Patent Classification/ 
Classification Internationale des brevets: 

A61B6/00 



Am Anmeldetag benannte Vertragstaaten/Contractl ng states designated at date of 
f1l1ng/Etats contractants designees lors du depot: 

AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL 
PL PT R0 SE SI SK TR LI 



04100879.8 
EPA/EP0/0EB Form 1014.2 - 01.2000 



7001014 



2 



PHDE040064 EPP 



DESCRIPTION 

Apparatus and method for the processing of perfusion images 

The invention concerns an image processing apparatus and a method for the 
reconstruction of time-dependent sectional images of an object, particularly during 
5 perfusion imaging. Moreover the invention relates to an X-ray examination system 
comprising such an apparatus and a computer program implementing said method 

Perfusion imaging is an important functional imaging method in medical applications 
which delivers information about the blood supply of the tissue and the tissue viability 
10 as well as valuable information during interventions. According to current techniques, 
perfusion imaging requires the acquisition of a time series (with typically about 40 
members) of (multiple) cross-sectional images with a ftame rate in the order of 0.75 - 
1 second. After acquisition and reconstruction of the individual cross-sectional images, 
the image time series is evaluated and a perfusion map is computed. 

15 

In a perfusion imaging procedure described in the US 6 373 920 Bl, a first set of 
projections is taken without contrast agent and later a second set of projections is taken 
with contrast agent. From the difference of the images reconstructed based on each set, 
a perfusion image is calculated. 

20 

As current C-arm X-ray systems are limited in their rotational speed and detector frame 
rate, such systems cannot be used for perfusion imaging based on cross-sectional 
images generated in short time intervals. 

25 Based on this situation it was an object of the present invention to provide means for a 
facilitated perfusion imaging, especially by use of normal C-arm based X-ray systems. 

This object is achieved by an image processing apparatus according to claim 1 , an X-ray 
examination system according to claim 7, a method according to claim 9, a computer 
30 program according to claim 1 0, and a record carrier according to claim 1 1 . Preferred 
embodiments are subject of the dependent claims. 
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According to a first aspect the invention comprises an image processing apparatus for 
the reconstruction of time-dependent cross-sectional images of an object The 
reconstructed images may especially be two-dimensional or three-dimensional, and the 
5 object may particularly be the vessel system of a patient where perfusion shall be 

investigated or where the flow of a contrast agent shall be reconstructed. As perfusion is 
a time-varying process, the respective cross-sectional images are not stationary but 
time-dependent, too. The apparatus is adapted to approximate the function I(x,t) - 
which represents the cross-sectional images — by a given parametric model function 
10 I*(a(x),t). Each value of the function I(x,t) describes the image signal (e.g. the grey- 
value) of a particular voxel x at time t. If three-dimensional cross-sectional images are 
reconstructed, I(x,t) is a function depending on four independent variables. The model 
function I*(a(x),t), in contrast, depends on the N-dimensional parameter vector a and 
time t in a known manner, because I*(a(x),t) is constructed or pre-selected by the user of 
15 the apparatus. All you have to know to describe the cross-sectional images with 

I*(a(x),t) is then the spatial dependence of the parameter vector a(x). In other words the 
problem of finding a spatially dependent functional I(x,*) for a continuum of times t is 
reduced to finding N spatially dependent functions a(x). In that respect the image 
processing apparatus is further adapted to estimate the N-dimensional parameter vector 
20 a(x) with the help of a set of projections p j of the object, wherein each projection pj is 
produced at some time t), and wherein the times tj are typically different from each 
other. Possible ways to carry out such an estimation are described in connection with 
preferred embodiments of the invention. 

25 By approximating the real image-function I(x,t) by a parametric function I*(a(x),t), the 
apparatus reduces the complexity of the reconstruction problem considerably. 
Moreover, this approximation has the advantage to allow an estimation of the parameter 
vector a and therefore of the desired description of the cross-sectional images by 
projections p ) that may in principle be arbitrarily distributed over time. In particular, it 

30 is not necessary to produce whole sectional images of a (quasi) stationary situation for 
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various time points which is for example not possible in perfusion imaging with a 
C-arm based X-ray system. With the described apparatus, however, such systems 
become applicable, and the projections generated by a C-arm system during one or more 

* 

sweeps may be used. 

5 

According to a first approach to calculate the desired parameter vector a(x), 
the apparatus is adapted to use an update function AI(x, p 1(?c) , f (x)) for the estimation of 
the parameter vector a, wherein the update function AI(x, p' 00 , f(x)) is taken from an 
iterative algorithm for the reconstruction of stationary cross-sectional images I(x). One 

1 0 important example for such an algorithm is known as "Algebraic Reconstruction 

Technique" (ART). Update functions based on this algorithm or derivatives thereof are 
especially suited for the present estimation method. In the update function, p K is a 
projection of an object used in the k-th iteration step, and I*(x) is the k-th estimate for 
I(x). The application of update functions of known algorithms has the advantage that 

1 5 well known mathematical procedures and existing tools may be exploited 

In a further development of the apparatus described above, the parameter vector a(x) is 
iteratively approximated by a sequence a k (x), wherein the (k+l)-th iteration comprises 
the following steps: 



20 



25 



a) The computation of k-th order estimates I*fe k (x)^j) for at least N of ^ ^ 
wherein the times t*j may in principle be selected arbitrarily. This selection of 
times may be described by corresponding index sets A and B according to ieA 
and j eB (wherein A and B normally change from iteration step to iteration step). 



b) The computation of corresponding updates 

Al^j^AICx.p^^CaWi)), 
wherein AI is the update function of a known iterative algorithm like ART. The 
update function makes use of said estimates I*(a k (x),t*j) and the measured 
30 projections p j that correspond to the selected times tj with i e A, j eB. 



PHDE040064 EPP 

-4- 



c) The calculation are the new estimate a (x) for the parameter vector by 
minimising the following function with respect to a** 1 : 

5 . 

The procedure described above will be discussed in more detail in the description of the 
accompanying figures. Its advantage is that it may be carried out iteratively based on 
standard algorithms like ART and thus may readily be implemented 

1 0 The projections pj of the object that are used for the estimation may in principle be 

arbitrarily distributed over projection angle and time, wherein the distribution should of 
course be such that no important developments in the processes to be observed in the 
object, e.g. a perfusion process, are missed. Preferably, however, the set of measured 
projections is structured into a number M of subsets, wherein each subset comprises 

15 only projections pj, j = 1, Q, which were taken from the same or approximately the 
same direction at different times. Moreover, the number Q of these projections in each 
subset is preferably greater or equal to the dimensionality of the parameter vector a, i.e. 
Q > N. In other words there are M different projection directions, and for each of these 
projection directions a number Q > N of single projections is produced at different time 

20 points. Such a structure of the projections allows to use at least N projections taken 
from the same direction in an iterative procedure for the estimation of a(x). Thus, for 
example, the iterative algorithm described above maybe carried out such that |A| = 1 in 
each iteration step, provided that the times tj with the same superscript i belong to the 
same projection direction. The use of projections from the same direction in each 

25 iteration step makes the approximation procedure more stable. It should be noted at this 

■ 

point that the separate indices i, j of the projections p j were introduced to reflect the 
aforementioned structure of the set of projections; if there is no such structure, the 
indices i and j are simply symmetrical, i.e. they play the same role. 
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A second approach to calculate the desired parameter vector a(x) for the parametric 
model function I*(a(x),t) maybe based on the optimisation of an objective function that 
compares measured and calculated projections. Especially, the objective function may 
5 measure the total deviation between all measured projections p j and the corresponding 
projections Pi l*(a(x),tj) that are calculated from the model function I*. Such an 
objective function may for instance be defined by the formula 

u 

An advantage of this approach is that it may readily be added to the usual image 
10 reconstruction procedures without a need to change them. Moreover, there are a priori 
no constraints on the kind of the used projections p j; they may for example all belong to 
different projection directions and time points. 

According to a further development of the apparatus, the estimation of the parameter 
1 5 vector a makes use of an anatomical reference data set. This reference data set may for 
example be a stationary cross-sectional image of the object 1hat was produced in 
advance. The use of such a reference data set allows it to reduce the number of 
independent components in the parameter vector by one, which simplifies the 
estimation process accordingly. Moreover, such a reference data set is especially useful 
20 in combination with the second approach described above where it may provide an 
appropriate starling value for the optimisation process. 

The invention further relates to an X-ray examination system comprising the following 
components: 

25 

A rotational X-ray apparatus, for example a C-arm based X-ray system, for 
generating X-ray projections p j of an object from different directions. 



30 



An image processing apparatus of the kind described above which is operatively 
connected with the X-ray apparatus. The apparatus is particularly adapted to 
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approximate the function I(x,t) that exactly describes the cross-sectional images 
by a given parametric model function I*(a(x),t), and to estimate the 
N-dimensional parameter vector a(x) with the help of a set of projections p j of 
the object, wherein each projection p j is produced at some corresponding time 
tj. The apparatus may especially be realised by a computer together with 
appropriate programs to execute the required image processing. 

Because the image processing apparatus allows to reconstruct time-dependent 
cross-sectional images from projections taken at different stages of the processes to be 
observed in the object, the rotational X-ray apparatus may especially be a conventional 
X-ray system with a C-arm. X-ray projections generated during one or more sweeps of 
such a system may be used for the reconstruction of the desired intensity function 
I*(a(x),t). 

According to a further development of the invention, the X-ray examination system 
described above comprises an injection system for injecting contrast agent into the 
blood flow of a patient. The injection system may for example comprise a catheter and a 
pumping unit for controllably introducing contrast agent through the catheter into the 
vessel system of a patient The injection system allows to perform perfusion imaging or 
reconstruction of contrast agent flow with the examination system. 

The invention further comprises a method for the reconstruction of time-dependent 
cross-sectional images of an object comprising the following steps: approximation of 
the function I(x,t) describing the cross-sectional images by a given parametric model 
function I*(a(x),t); and estimation of the N-dimensional parameter vector a(x) with the 
help of a set of projections p j of the object produced at times tj. The method comprises 
in general form the steps that can be executed with an image processing apparatus of the 
kind described above. Therefore, reference is made to the preceding description for 
more information on the details, advantages and improvements of that method. 

Moreover, the invention comprises a computer program for enabling carrying out a 
method of the kind described above. Such a computer program together with a general- 
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purpose computer may especially constitute an image processing apparatus of me kind 
described above. 

* 

Finally, the invention comprises a record carrier on which a computer program of the 
5 kind described above is stored. The record carrier may be any kind of permanent or 
volatile storage medium like RAM, ROM, hard disk, floppy disk, CD, magnetic tape or 
the like. 

These and other aspects of the invention will be apparent from and elucidated with 
10 reference to the embodiments) described hereinafter. 

In the following the invention is described by way of example with the help of the 
accompanying drawings, in which: 

1 5 Figure 1 is a principle sketch of an X-ray examination system and the method to 
generate projections for perfusion imaging according to the present invention. 

Figure 2 is a diagram of a typical course of time-dependent grey-values and its 
approximation according to the present invention. 

20 

The drawing in the upper left comer of Figure 1 schematically depicts the setup of an 
X-ray examination system according to the present invention. The examination system 
comprises a rotational X-ray apparatus 3 which is adapted to generate X-ray projections 
of an object from different directions &\ for example of the vessel system 2 of patient to 
25 be examined. The rotational X-ray apparatus 3 may especially be a conventional C-arm 
based X-ray system comprising an X-ray source 4 and an X-ray detector 6 connected via 
a C-arm 5. The X-ray apparatus 3 is connected to an image processing apparatus 1, 
which may for example be a workstation with appropriate software running on it. 

30 During perfusion imaging or reconstruction of flow in medical diagnostics, a contrast 
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agent is injected into the vessel system 2 of patient by a catheter (not shown), and the 
spreading of this injection is monitored in order to gain information on the perfusion 
properties of the vessel system. Due to the temporal development of the perfusion 
process, the observed image signal of a voxel at position x is not constant but usually 
5 varies over time. Figure 2 shows a typical time-dependence of the grey-value I(x,t) of a 
voxel x during a perfusion study (black line). The complete temporal development in 
the volume to be observed must therefore be described by an intensity function I(x,t) 
which depends on the three-dimensional position vector x (in cases of 
three-dimensional image reconstruction) and the one-dimensional parameter time t. 

10 

An important step of the procedure to be described in the following is the 
approximation of said function I(x,t) by a model function I*(a(x),t) that is 
predetermined by the user of the system and that depends on an N-dimensional 
parameter vector a and oh time t in a known way. The only unknown relation will then 

15 be the spatial dependence of the parameter vector a(x). The grey curve in Figure 2 

shows a typical example of a model function I*(a(x),t) with an 8-dimensional parameter 
vector a(x), wherein pairs of components (a^ am) describe one point in the temporal 
course of the model function and wherein these points are connected by straight lines. 
Of course a lot of other different approximations are suitable, too, for example 

20 polynomial functions or the like. The user will typically choose a model function such 
that it will describe the a priori expected course of intensity values with a minimal 
number of independent parameters. 

In the following, a preferred procedure for the estimation of the parameter vector a(x) in 
25 the setup described above will be described. The procedure comprises the generation of 
projections pj with the X-ray apparatus 3 from different projection directions d* while a 
perfusion process is going on in the vessel system 2. In a preferred embodiment, the 
X-ray apparatus 3 is rotated forward and backward in such a way that for each of M 
projection directions d 1 at least N projections p j (1 < j < N) at different time points tj are 
30 acquired. 
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From the state of the art iterative reconstruction algorithms such as ART (Algebraic 
Reconstruction Technique) are well known (cf. e.g. G. T. Herman, L. B. Meyer; Alge- 
braic Reconstruction Techniques can be made Computationally Efficient; IEEE TMI 12 
5 (3), p. 600ff, 1993; F. J. Beekman, C. Kamphuis; Fast Ordered Subset Reconstruction 
for X-ray CT; IEEE Nuclear Science Symposium Conference Record; Volume 2, 2000). 
La these algorithms, the iterative reconstruction of a stationary 3D image I(x) is 
achieved with projections p* of an object and the recursion formula 

4 

10 i w (*)=i*W + Af(j5^ w f i*(*)) f (i) 

wherein t(x) approximates the unknown function I(x). In many algorithms (including 
ART), AI depends only on the projection of t(x) taken from the same direction as p l(k) . 

When extending such an algorithm to the non-stationary situation of perfusion imaging 
15 as it was described above, a similar formula is needed for the iterative approximation of 
the parameter vector a(x) by a sequence a k (x). 

Assume that the k-th element a k (x) of this sequence is already known and define 
f(x,t) := I*(a k (x), t). The next iteration step for finding a** \x) must be carried out for 
20 one of the time points t*j for which a projection p ) is available. For this fixed time point 
t*j, the recursion formula (1) may analogously be applied, which yields 

= /*(a*(x),r}) + A/(x;^,r(a*(x),^) 
= /V(*),fp + A/f 

25 From this equation the difference between the model function I*(a^(x),t )) at the new 
(unknown) parameter vector *(x) and the (known) updated function ^(x,^) can be 
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calculated as: 

z;=/v +1 (*)4)-/* +i (*,o 

A reasonable postulation is now to make as small as possible by an appropriate 

5 choice for a 1 ^ 1 (x). As the vector a has N components, this postulation alone would 
however have many solutions and thus convergence cannot be guaranteed. Therefore, it 
is better to adapt several (preferably all) components of a^Cx) simultaneously by 
requiring the minimisation of 



10 x 2 (x)= £Utf- 2fr(tt*M-rtf<rt.*A-Ai*'jV)f m 

wherein A, B are index sets that may in principle be chosen arbitrarily for each iteration 
step, and wherein the number QA|-f-|B|) of the terms is preferably greater or equal to N. 



15 In order to guarantee a stable convergence (due to a balanced contribution of all 
components of a to the minimization), it is preferred to choose for the iteration step 
k -> (k+1) only projections taken from the same direction d . This means that |A| = 1 
and |B| ^ N in equation (2). Especially the function 



25 



may be minimized in order to find for each voxel x the new parameter vector af^x). 
This solution may be found, for instance, by a least-squares method or some other 
suitable procedure known from numerical mathematics. 

In summary, each iteration step of the reconstruction algorithm can be realized by 

Computation of N estimates F(a\x),tj) for the time points t?i,... ,tn based on the 
already known parameter vector a k (x) and an (arbitrarily chosen) index i. 
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Computation of N updates AI kJ i,..., M kJ N using the acquired projections pj and 
said N estimates. 

Computing during backprojection for each voxel x the updated parameters 
a w (x) by minimizing % 2 (*) • 

5 

As variants, the algorithm can also be carried out if the projection directions d 1 of the N 
projections pS,.~,PN differ slightly. In particular, the projections acquired with an 
angular difference about 1 80° at the turning point of the C-arm movement can be 
considered simultaneously within a reconstruction iteration to improve stability. 
1 0 Furthermore, an anatomical reference data set can be used to reduce the number N of 
parameters'*),...,**^*) by 1. 

According to another approach, the parameter vector a(x) may be found by 
minimisation of an objective function like 

15 z 2 =ste-^ 7 *few,6)y, 

wherein 1 < i < M, 1 < j <■ N, and wherein Pj denotes the operator projecting the image 
I*(a(x),t) according to the projection geometry d 1 . In this case it is not necessary (or 
helpful) that all projections p j with the same superscript i belong to the same projection 
direction. In contrast to the diagram of Figure 1, the p) may therefore be quite arbitrarily 
20 distributed over projection angles and time. 

Minimisation of the function x. 2 may e.g. be achieved by an iterative procedure. In this 
case it is preferred to use a (2D or 3D) sectional image of the region of interest as a 
starting value for I^x),^). Such a "starting image" may be produced by any 
25 appropriate method, e.g. by backprojection from a set of projections. Moreover, the 
starting image may be taken from previously (e.g. days before the perfusion imaging) 
recorded data, thus rninimising the X-ray exposure of the patient. Preferably, however, 
the starting image is produced immediately before the projections p'j in order to 
correspond to the situation on these projections as close as possible. 
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The invention enables perfusion imaging on C-ann based X-ray systems as it does not 
require acquisition of (multiple) cross-sectional images with a frame rate in the order of 
1 second When applied on multi-slice CT (MSCT) systems, the invention facilitates 
5 perfusion protocols with considerably reduced dose. 

Finally it is pointed out that in the present application the term "comprising" does not 
exclude other elements or steps, that "a" or "an" does not exclude a plurality, and that a 
single processor or other unit may fulfill the functions of several means. Moreover, 
10 reference signs in the claims shall not be construed as limiting their scope. 
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CLAIMS 



1. Image processing apparatus (1) for the reconstruction of time-dependent cross- 
sectional images of an object (2), the apparatus (1) being adapted 

to aooroximate foe function I(x,f) which describes foe cross-sectional images by 

fx* 

a predetermined parametric model function I*(a(x),t); and 
5 - to estimate foe N-dimensional parameter vector a(x) with foe help of a set of 
projections p j of foe object (2) generated at times tj. 

2. Apparatus according to claim 1, characterized in that foe estimation of the parameter 
vector a(x) is based on foe update function AI(x, p i(k) , ?(*)) of an iterative algorithm for 

10 foe reconstruction of a stationary cross-sectional image I(x), wherein p ,<k) is a projection 
used in foe k-fo iteration step and t^x) is foe k-fo estimate for I(x). 

3. Apparatus according to claim 2, characterized in that foe parameter vector a(x) is 
iteratively approximated by a sequence a k (x), wherein foe (k+l)-fo iteration comprises 

15 the following steps: 

a) computation of estimates POftftlfr for * least N of 4511168 wherein * e A 
and j e B for some index sets A, B; 

b) computation of corresponding updates A? 1 j = AI(x, p j, I*(a k (x)>tj)) 

wifo foe help of said estimates I*fe k (x)»tj) «ad foe measured projections p*j that 

20 correspond to the times tj; 

c) calculation of foe new estimate a^^x) for foe parameter vector a(x) by 

minimising 

X \x)= 2(/*(a* +1 (x),6)-/*(fi*W J 6)-A/*-''/W) i > 
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4. Apparatus according to claim 1, characterized in that the set of measured projections 
p j can be divided into M subsets, wherein each subset comprises only projections pj, 

j = 1,...Q taken from the same or approximately the same direction (d 1 ) at different times 
5 tj, and wherein Q > N. 

5. Apparatus according to claim 1, characterized in that the estimation of the parameter 
vector a(x) is based on the minimisation of an objective function evaluating the 
deviation between the measured projections p j and corresponding projections Pi 

10 I*(a (x),tj) calculated from the model function, wherein the objective function 
preferably is defined as 

6. Apparatus according to claim 1, characterized in that the estimation of the parameter 
1 5 vector a(x) makes use of an anatomical reference data set, 

7. X-ray examination system, comprising 

a rotational X-ray apparatus (3) for generating X-ray projections p j of an 
object (2) from different directions; 
20 - an image processing apparatus (1) according to one of claims 1 to 5. 

8. The system according to claim 7, comprising an injection system for injecting a 
contrast agent into the blood flow of a patient. 

25 9. Method for the reconstruction of time-dependent cross-sectional images of an 
object (2), comprising the following steps: 

approximation of the function I(x,t) which describes the cross-sectional images 



15 



PHDE040064 EPP 



by a predetermined parametric model function I*(a(x),t); and 

estimation of the N-dimensional parameter vector a(x) with the help of a set of 

projections pj of the object (2) generated at times tj. 

10. Computer program for enabling carrying out a method according to claim 9. 

11. Record carrier on which a computer program according to claim 10 is stored 
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ABSTRACT 

Apparatus and method for the processing of perfusion images 

The invention relates to an apparatus and a method for the reconstruction of time- 
dependent cross-sectional images and may be applied for example in perfusion imaging 

w 

5 in the vessel system (2) of a patient According to the method, projections p) are 
generated from a number M of different directions d and at different times tj. 
Moreover, the time-dependent intensity function I(x,t) of the reconstructed volume is 
approximated by a predetermined model function I*(a(x),t), wherein the unknown 
parameter vector a(x) is estimated for each voxel x. This estimation may be done using 
10 the update functions of known reconstruction algorithms like ART for at least N 
projections p'j in each iteration step. 

Fig.1 

15 
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Fig. 2 



